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DETAILED ACTION 

Response to Arguments 

The response filed on July 8, 2008 has been received and considered. Claims 1 , 2, 5-7, 
and 10 are currently pending. 

Applicant's Argument: 

"Therefore, unlike the invention recited in applicant's claims 1 and 6, Kanzaki's 
threshold value is not used in detecting a peak in a spectrum of luminance values 
(predetermined physical quantity). In sum, while applicant and Kanzaki both use a 
threshold value, it is used for completely different purposes. Kanzaki uses its threshold 
value (average luminance value) to evaluate a luminance value of each pixel in an 
image, while applicant's threshold value of claims 1 and 6 is used to detect a peak in a 
spectrum of predetermined physical quantity (e.g., luminance). Tamura's use of 
threshold values differs from Kanzaki in the same manner. Thus, applicant's invention 
as recited in claims 1 and 6 is not obvious over Tamura in view of Kanzaki's completely 
different method of setting and using threshold values." 

Examiner's Response: 



Using an average physical quantity in order to set a threshold for detection 
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of changes in a physical quantity is well-known as shown in the Kanzaki 
reference. As shown in FIG. 2 and discussed in column 7, line 48 to column 8, 
line 50, an automatic threshold value section 12 calculates an average value of 
luminance of picture elements and determines a threshold value which is used to 
detect image portions where inputted image data is different in luminance from 
the background image data, areas of peak luminance compared to the rest of 
image. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1, 2, 5, 6, 7, and 10 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Tamura et al (US 6,040,860) and Kanzaki et al. (6,137,531). 

Regarding claim 1, Tamura discloses an image processing device for acquiring 
image data to be processed ("comprises an imaging element for outputting an image 
signal", column 2, line 62), extracting a spectrum of a predetermined physical quantity in 
said image data ("FIG. 4 is a sample luminance histogram showing the feature quantity 
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extracted by the feature quantity extraction circuit 107", column 4, line 28), making a 
determination as to whether or not said spectrum has a plurality of peaks ("This 
luminance histogram (FIG. 4bcd) shows that there are two luminance peaks with one in 
the low luminance range and one in the high luminance range. This makes it possible to 
deduce that the captured image contains a backlit subject.", column 8, line 65), and 
performing a process based on a result of the determination, wherein the process is a 
backlighting correction process(The image evaluation means 108 then sets the 
compensation rate of the gradation compensation characteristic used to compensate 
the input image based on the luminance histogram extracted by the feature quantity 
extraction circuit 107, column 9, line 2), wherein the determination as to whether or not 
said spectrum has a plurality of peaks is made based on, with respect to said spectrum, 
an integral value of a range where said physical quantity is no greater than a first 
threshold, and an integral value of a range where said physical quantity is no smaller 
than a second threshold which is greater than said first threshold ("FIG. 4 is a sample 
luminance histogram showing the feature quantity extracted by the feature quantity 
extraction circuit 107 in the present embodiment of the invention. Curve a in FIG. 4 is 
the luminance histogram where the low luminance pixel count of pixels with a luminance 
value less than or equal to threshold value 1 is level b, the middle luminance pixel count 
of pixels with a luminance value between threshold value 1 and threshold value 2 is 
level c, and the high luminance pixel count of pixels with a luminance value greater than 
or equal to threshold value 2 is level d.", column 7, line 6; "This luminance histogram 
(FIG. 4bcd) shows that there are two luminance peaks with one in the low luminance 
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range and one in the high luminance range. This makes it possible to deduce that the 
captured image contains a backlit subject.", column 8, line 65). 

Tamura does not disclose wherein at least one of said first and second 
thresholds is set based on an average level of said physical quantity of said image data . 

Kanzaki teaches wherein at least one of said first and second thresholds is set 
based on an average level of said physical quantity of said image data (Kanzaki, 
column 8, lines 18-22). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify the invention of Tamura to include thresholds being set based on the 
average level of luminance of said image data as taught by Kanzaki rather than having 
predetermined or fixed thresholds so that, as stated in the Kanzaki reference in column 
8 between lines 18 and 22, "depending on the calculated average value of luminance, 
the automatic threshold value section 12 determines a threshold value necessary for 
subsequent Step 3. As the average value of luminance becomes larger, a larger 
threshold value is determined." In this way, since threshold values are determined for 
the actual images based on the image's actual characteristics, it will provide 
backlighting information more relevant to the chosen inputted images. 

Regarding claim 2, Tamura discloses the image processing device according to 
claim 1, wherein said physical quantity is a signal varied in accordance with a change in 
an amount of light or a luminance ("FIG. 4 is a sample luminance histogram showing the 
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feature quantity extracted by the feature quantity extraction circuit 107", column 4, line 
28) . 

Regarding claim 5, Tamura discloses the image processing device according to 
claim 3, wherein said first threshold is smaller than the average level of said physical 
quantity, and said second threshold is greater than the average level of said physical 
quantity(Fig. 4 and Fig. 5a; column 7, lines 6-16, Tamura is separating a histogram 
spectrum into three luminance regions and because the average luminance is related to 
the middle luminance region (Fig. 5a) in order to evaluate the amount of backlighting in 
a typical image input signal (column 8, lines 56-58; Fig. 3), the first threshold is smaller 
than the average level of the luminance, and said second threshold is greater than the 
average level of the luminance.), and said spectrum is determined as having a plurality 
of peaks when satisfying at least two conditions out of: a first condition that an integral 
value of a range where said physical quantity is no greater than said first threshold is no 
smaller than a first percentage of an integral value of the entire range(column 7, line 9- 
11; column 7, line 17-20; Fig. 2, num. 107 and 108); a second condition that an 
integral value of a range where said physical quantity is no smaller than said second 
threshold is no smaller than a second percentage of the integral value of the entire 
range (column 7, lines 14-16; column 7, line 21-22; Fig. 2, num. 107 and 108) ); and a 
third condition that a sum of the integral value of the range where said physical quantity 
is no greater than said first threshold and the integral value of the range where said 
physical quantity is no smaller than said second threshold is no smaller than a third 
percentage of the integral value of the entire range. 
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Regarding claim 6, Tamura discloses an image processing method for acquiring 
image data to be processed ("comprises an imaging element for outputting an image 
signal", column 2, line 62), extracting a spectrum of a predetermined physical quantity in 
said image data ("FIG. 4 is a sample luminance histogram showing the feature quantity 
extracted by the feature quantity extraction circuit 107", column 4, line 28), making a 
determination as to whether or not said spectrum has a plurality of peaks ("This 
luminance histogram (FIG. 4bcd) shows that there are two luminance peaks with one in 
the low luminance range and one in the high luminance range. This makes it possible to 
deduce that the captured image contains a backlit subject.", column 8, line 65), and 
performing a process based on a result of the determination, wherein the process is a 
backlighting correction process(The image evaluation means 108 then sets the 
compensation rate of the gradation compensation characteristic used to compensate 
the input image based on the luminance histogram extracted by the feature quantity 
extraction circuit 107, column 9, line 2), wherein the determination as to whether or not 
said spectrum has a plurality of peaks is made based on, with respect to said spectrum, 
an integral value of a range where said physical quantity is no greater than a first 
threshold (, and an integral value of a range where said physical quantity is no smaller 
than a second threshold which is greater than said first threshold ("FIG. 4 is a sample 
luminance histogram showing the feature quantity extracted by the feature quantity 
extraction circuit 107 in the present embodiment of the invention. Curve a in FIG. 4 is 
the luminance histogram where the low luminance pixel count of pixels with a luminance 
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value less than or equal to threshold value 1 is level b, the middle luminance pixel count 
of pixels with a luminance value between threshold value 1 and threshold value 2 is 
level c, and the high luminance pixel count of pixels with a luminance value greater than 
or equal to threshold value 2 is level d.", column 7, line 6; "This luminance histogram 
(FIG. 4bcd) shows that there are two luminance peaks with one in the low luminance 
range and one in the high luminance range. This makes it possible to deduce that the 
captured image contains a backlit subject.", column 8, line 65). 

Tamura does not disclose wherein at least one of said first and second 
thresholds is set based on an average level of said physical quantity of said image data . 

Kanzaki teaches wherein at least one of said first and second thresholds is set 
based on an average level of said physical quantity of said image data (Kanzaki. 
column 8, lines 18-22). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify the invention of Tamura to include thresholds being set based on the 
average level of luminance of said image data as taught by Kanzaki rather than having 
predetermined or fixed thresholds so that, as stated by the Kanzaki reference in column 
8 between lines 18-22, "depending on the calculated average value of luminance, the 
automatic threshold value section 12 determines a threshold value necessary for 
subsequent Step 3. As the average value of luminance becomes larger, a larger 
threshold value is determined." In this way, since threshold values are determined for 
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the actual images based on the image's actual characteristics, it will provide 
backlighting information more relevant to the chosen inputted images. 

Regarding claim 7, Tamura discloses the image processing method according 
to claim 6, wherein said physical quantity is a signal varied in accordance with a change 
in an amount of light or a luminance ("FIG. 4 is a sample luminance histogram showing 
the feature quantity extracted by the feature quantity extraction circuit 107", column 4, 
line 28). 

Regarding claim 10, Tamura discloses the image processing method 
according to claim 7, wherein said first threshold is smaller than the average level of 
said physical quantity, and said second threshold is greater than the average level of 
said physical quantity (Fig. 4 and Fig. 5a; column 7, lines 6-16, Tamura is separating a 
histogram spectrum into three luminance regions and because the average luminance 
is related to the middle luminance region (Fig. 5a) in order to evaluate the amount of 
backlighting in a typical image input signal (column 8, lines 56-58; Fig. 3), the first 
threshold is smaller than the average level of the luminance, and said second threshold 
is greater than the average level of the luminance.), and said spectrum is determined as 
having a plurality of peaks when satisfying at least two conditions out of: a first condition 
that an integral value of a range where said physical quantity is no greater than said first 
threshold is no smaller than a first percentage of an integral value of the entire range 
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(column 7, line 9-1 1 ; column 7, line 1 7-20; Fig. 2, num. 1 07 and 1 08); a second 
condition that an integral value of a range where said physical quantity is no smaller 
than said second threshold is no smaller than a second percentage of the integral value 
of the entire range (column 7, lines 14-16; column 7, line 21-22; Fig. 2, num. 107 and 
108); and a third condition that a sum of the integral value of the range where said 
physical quantity is no greater than said first threshold and the integral value of the 
range where said physical quantity is no smaller than said second threshold is no 
smaller than a third percentage of the integral value of the entire range. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ELISA M. RICE whose telephone number is (571)270- 
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1582. The examiner can normally be reached on 12:00-8:30p.m. EST Monday thru 
Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Vikkram Bali can be reached on (571)272-7415. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Elisa M Rice/ 
Examiner, Art Unit 2624 

/Vikkram Bali/ 

Supervisory Patent Examiner, Art Unit 2624 



